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We investigate numerically the dynamics of large networks of N globally pulse-coupled integrate 
and fire neurons in a noise-induced synchronized state. The powerspectrum of an individual element 
within the network is shown to exhibit in the thermodynamic limit (N — > oo) a broadband peak and 
an additional delta-function peak that is absent from the powerspectrum of an isolated element. 
The powerspectrum of the mean output signal only exhibits the delta-function peak. These results 
are explained analytically in an exactly soluble oscillator model with global phase coupling. 
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The response of dynamical systems to noise has re- 
ceived considerable attention recently. Most of the work 
has focused on cases where the noise was found to in- 
crease the coherence of the system. One such case is 
stochastic resonance jjj , where a particle in a bistable po- 
tential is subject to noise, in conjunction with a weak pe- 
riodic force. The inclusion of noise facilitates the switch- 
ing of the particle between the two wells and leads to an 
increase in the signal-to-noise ratio of the output signal. 
The signal-to-noise ratio is further increased in the case 
of a chain of oscillators with a bistable potential 0| . It 
has been shown that stochastic resonance is not limited 
to systems with a bistable potential but can occur also 
in a single excitable element || and in spatially extended 
excitable systems 0. Furthermore, studies on the effect 
of noise in globally coupled maps 0, in mathematical 
models that display stable and unstable fixed points |||7]] 
and in globally coupled oscillators Q showed that noise 
can induce a coherent response even in the absence of an 
external periodic force. 

Excitable elements underly many biological functions 
and are often subject to complex external stimuli which 
can be aperiodic in time and/or exhibit random varia- 
tions in amplitude. Neurons in the brain are excitable 
units that are connected to a large number of other neu- 
rons (typically 1000-10000 §). They can be stimulated 
by signals from the external world or other parts of the 
brain. These signals are subject to synaptic noise. In a 
number of situations, including seizures |ic| and signal 
processing in the visual cortex |Q, large collections of 
neurons fire synchronously and generate a coherent out- 
put signal. 

In this letter, we investigate the dynamics of large net- 
works of N globally coupled excitable elements that ex- 
hibit a globally synchronized state above a critical noise 
threshold [Q. We focus on understanding how the dy- 
namical behavior of an individual element within the net- 
work differs from that of an isolated element (i.e. not 
coupled to any other elements), as well as on the mean 
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FIG. 1. Schematic drawing of the powerspectra of the 
mean output signal of an infinite noise-driven network (a 
delta- function at ujo, the intrinsic frequency of the elements), 
the signal of a individual element within this network (a 
delta- function at uiq plus a broadband peak at uiq) and of 
the signal of an isolated element (a broadband peak at wo). 



output signal of all the elements. The main result of 
interest is drawn schematically in Fig. 1. The power- 
spectrum of the individual element within the network 
exhibits both a broadband peak and, in the thermody- 
namic limit, a delta-function peak that is absent from the 
powerspectrum of an isolated element. The powerspec- 
trum of the mean output signal, in contrast, only exhibits 
a delta- function peak in that limit. We show that these 
results can be qualitatively understood analytically in a 
noisy oscillator model with global phase coupling. It is 
important to emphasize that the coherence in our neural 
network is induced solely by noise in conjunction with the 
global coupling, and not by a periodic external driving 
force as in standard stochastic resonance. It also does 
not depend, as in earlier work in neural networks, on a 
constant DC drive Jl3| , the oscillatory nature of the ele- 
ments 1 14 , special initial conditions |l5[ or an additional 
cellular mechanism |16fl. 



The model we study numerically is the globally pulse- 
coupled integrate-and-fire model (I&F) Jl?]] modified to 
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include a relative refractory period: 

n^- = -h i + pr(t)+RVi(t) (i) 

where t± is the membrane time constant and where 
describes the synaptic input current that decays with a 
time constant T2: 

Here, denotes the firing time of the j-th neuron, the 
coupling constant, and R the resistance. If the membrane 
potential hi reaches a threshold value 0(t), the element 
fires a delta-function pulse after which hi is immediately 
reset to zero. The threshold value for every element is a 
function of the time chosen as: 

9(t) =00 t-t f < T ref (3) 
9{t)=T 3 /(t-t f -T ref ) + e t-t f >T ref (4) 

This models an absolute refractory period T re f during 
which an clement cannot fire followed by a relative refrac- 
tory period. The relevant timescale during the relative 
refractory period is r 3 /8 and is chosen here to be of the 
same order as T re f. Finally, the noise term r]i is uncorre- 
cted and taken to be Gaussian with mean < T)i(t) >= 
and < m{t)Vj(t') >= 2D6{t - f%j. 

We have integrated eqns (1,2) numerically using a sec- 
ond order stochastic Runge-Kutta method. We have 
calculated the powerspectra of (i) an isolated element, 
Piso(&), (ii) an individual element within the network 
Pi(ui), and (iii) the mean h = Yli Jfhi °f au> the ele- 
ments, P rnean (cu). The resulting signal of an individual 
element consists of a series of delta-function pulses at 
the firing times < t{ d < T: h,(t) = ~ 
The Fourier components of hi are then given by hi{u) = 
J2j exp[—iu)tfj] from which we can compute the pow- 
erspectrum defined as Pi(ui) = T^ 1 < \hi(ui)h*(uj)\ >. 
Pi{uj) is averaged over different numerical runs and the 
normalization factor is introduced to ensure that it is in- 
dependent of T in the limit of large T. The powerspectra 
Pi SO (uj) and Pmeaniu) are calculated in the same way. 

Simulations reveal that noise can induce a dramatic in- 
crease in the coherence of the global output signal. The 
increase is achieved when the N elements are completely 
or nearly completely synchronized which leads to a coher- 
ent firing state. This noise induced state is sandwiched 
between two incoherent states at small and large noise 
levels. This is in agreement with recent work on a model 
of stochastic rotator neurons P4] . To illustrate the tran- 
sitions to the incoherent states we have plotted in Fig. 
^| the height H of the peak in P mea n normalized to the 
maximum height, H max , as a function of the noise (solid 
circles). The first transition, for small noise levels, cor- 
responds to the onset of synchronization and occurs on 
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FIG. 2. The normalized height of the peak of the pow- 
erspectrum as a function of the noise level D for the mean 
output signal of a network of I&F neurons (solid circles) and 
for an isolated element (open circles). The parameter values 
are n = 1, r 2 = 0.1, r 3 = 0.004, T ref = 0.3, Oo = 0.01, F = 5 
(for both the isolated element and the network) and Kij = 1, 
R = 1, N = 100 (for the network). We have checked that 
different parameter values give similar results. 

very short timescales; typically less than 1-2 refractory 
periods. The second transition, for large noise levels, 
corresponds to the destruction of synchronization due to 
noise and occurs because some elements are far from their 
rest state and cannot be entrained on the timescales t\ 
and T2 of the coupling and membrane potential. In be- 
tween the two transitions H has a clear maximum for a 
non-zero noise level. 

It is interesting to note that a single isolated I&F ele- 
ment exhibits also a transition from incoherent behavior 
to a more periodic behavior as the noise level is increased. 
In Fig. H we show H corresponding to Pi so , again nor- 
malized by H max , as a function of D (open circles). For 
weak noise, the rate of escape over the threshold is very 
small and the resulting timeseries for h can be effectively 
described as shot noise: the pulses are independent and 
have a Poisson distribution pq| . For larger noise levels 
escape events are more frequent and the mean time be- 
tween two firing events approaches T re f which leads to a 
coherence and an increase in H. However, since T re f is 
fixed the coherence for an isolated element is, in contrast 
to networks, not destroyed by large noise. 

In Fig. U we plot for a fixed noise level the power- 
spectra Pmean, Pi, and Pi SO - The noise level is chosen 
such that the network is in the noise induced coherent 
state. Consequently, P m ean displays a sharp peak at a 
frequency that is the inverse of the refractory period. 
This refractory period and hence the frequency of the 
peak are functions of the noise level. It can be clearly 
seen in the figure that the peak of the global output sig- 
nal is much higher and sharper than the peak for an 
isolated element at the same noise level. We have found 
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FIG. 3. Comparison of the powerspectra of the signal of 
the mean (Pmean), of a individual element in the network (Pi) 
and of an isolated element (P; so ). The parameter values are 
as in Fig. 2 with D = 10~ 3 and D = 10" 4 (inset). 



that the height of the sharp peak scales as N while the 
width scales as 1/N. This indicates that in the thermo- 
dynamic limit this peak becomes a delta-function. The 
powerspectrum for an individual element within the net- 
work displays a nearly identical sharp peak at the same 
frequency but has also a broadband peak at a different 
frequency than the sharp peak. In contrast to the latter, 
the broadband peak for the individual element within the 
network remains unchanged in the thermodynamic limit. 
Moreover, this peak is much higher than that for an iso- 
lated element which is still in a shot noise regime for this 
noise level as shown in Fig. 2. 

In the entire noise induced coherent region P me£m dis- 
plays a sharp peak that will approach a delta-function for 
infinite N. The broadband peak of Pi however, depends 
on the noise level. It is maximal near the high noise level 
transition and minimal near the low noise level transition 
(see Fig. |^) . This can be seen in the inset of Fig. || where 
we have shown P m ean and Pi for a smaller noise level. 

Our findings can be qualitatively understood as fol- 
lows: the noise induces the elements to exceed the thresh- 
old value and to fire. For sufficiently strong coupling, 
this results in a coherent synchronous state in the net- 
work which produces a sharp peak in the powerspectrum. 
As we increase N, the average noise decreases as 1/N 
which leads to a delta-function peak in the thermody- 
namic limit. An individual element within the network 
is driven by the mean which results in a sharp peak that 
becomes a delta-function peak for infinite networks. Each 
element however, experiences its own non-zero noise that 
produces a broadband peak. The broadband peak is in- 
dependent of N and decreases for decreasing noise levels. 

An analytical understanding of these spectra can be 
obtained in a model of globally coupled oscillators, qi — 
e Ic ^ , of constant amplitude but varying phase whose dy- 



4>i = ujq + J{4> - (j>i) + r\ % 



(5) 



where loq is the intrinsic frequency of the oscillator, J is 
the coupling strength, is the mean phase: = j^Yl'Pi 
and < T]i(t)r]j(t') >= 2D6(t — t')8ij. There are two moti- 
vations for studying this model. Firstly, the fact that the 
elements are excitable does not seem essential once they 
have escaped and are entrained on the global limit cycle. 
Secondly, the amplification of the output signal with in- 
creasing N is due to phase coherence of the oscillators, 
which is captured by the coupling term in Eq. (^). We 
are interested in calculating the average powerspectrum 
of the order parameter qjv = jf^Qi- 
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with 



< lN(t)q* N (t + t) > e 



(6) 



< q N {t)q* N {t + T) >=J^J2< 

0,k 



o i(0i(*)-0 fc (t+r)) 



> (7) 



In addition, we calculate the average powerspectrum of 
an individual element within the network: 



< qi (t)q*(t + r) > e 



r dr 



(8) 



Exact expressions for these spectra can be derived by first 
rewriting (JsJ) in the form 

di = —Jiti + rji + J J fidt' (9) 

where we have defined Ui = <pi — uj$t and where /x 
is the average noise: fj, = jj^Vi with correlation < 
fj,i(t)^,j(t') >= 2j^5(t — t')Sij. Integrating this equation 
then gives: 

Ui (t)=e- Jt [ dt ie Jtl Vi(h) + J f Hdr (10) 



Finally, using the identity 

< e *(wi(t)-«*(i+r)) > = e -±<(u j (t)-u k (t+T))' 2 > ^ Q-g 

we obtain after lengthy but straightforward algebra that 
in the limit of large N the powerspectrum for the mean 
is a Lorentzian of the form: 



e 



_D 

N 



(J2_)2 + (u; -U;)2 



(12) 



As in our simulations, the peak-height of P m ean scales 
as N, the width scales as 1/N and Pmean approaches a 
delta-function 27rexp[— D/2J]S(ui — ujq) as N — > oo. 
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The powerspectrum for an individual element within 
the network in the limit of large, but finite, N is given 
by Pj(w) = P me(m M + Z(w) where 



I(uj) = e J"^ dr cos ((cj - uj)t) e 



—a J\t\ 



(exp [— a(< 



— a J\t\ 



- 1) + Nae- J W] - 1) 



(13) 



and a = D/2JN. Thus, Pi consists of two distinct 
parts: P m ean and a peak centered around U)q that re- 
mains broadband and that can be written in the thermo- 
dynamic limit as: 



I {(J) = e 2J 



J dr cos ((cjq — u))t) ^exp 



D 
2J ( 



-J\r\ 



1 



(14) 



These results show that this simple model can capture 
the dependence on N of these powerspectra in the noise- 
induced synchronized state: 1) P me an becomes a delta- 
function in the thermodynamic limit and 2) Pi has the 
same delta-function peak plus a broadband peak in this 
limit. This model, however, does not reproduce the de- 
pendence on noise of these powerspectra because it is 
oscillatory and not excitable as the I&F model. Firstly, 
this oscillator model does not exhibit the two transitions 
present in our excitable networks as shown in Fig. |[ In- 
stead, both P mea n(w) and Pi(ui) decrease exponentially 
with D and reduce to a delta function in the limit of van- 
ishing D, Secondly, the broadband peak of an isolated 
element (obtained by taking the limit J — > in Eq. 14) 
is higher than the peak of an individual element within 
the network, while the opposite occurs in the I&F model 
because isolated elements exhibit shot-noise. Finally, we 
note that in the oscillator model the broadband peak 
is symmetrically centered around the delta-function. In 
our simulations however, the broadband peak is not sym- 
metric and occurs at a different frequency than the sharp 
peak. This is simply due to the asymmetry in the func- 
tion describing the refractory period (Eqns. [3,4]). 

In summary, we have investigated the noise induced 
coherent state in a globally coupled neural network. The 
powerspectrum of the global output signal exhibits a 
sharp peak with a height that scales as TV and that be- 
comes a delta- function in the thermodynamic limit. The 
powerspectrum of an individual element within this net- 
work displays the same sharp peak and an additional 
broadband peak. Identical qualitative powerspectra are 
reproduced by a simple oscillator model with global phase 
coupling, demonstrating that the excitable nature of the 
elements is not crucial. Thus, these spectra should be 
present in any excitable and oscillatory stochastic system 
with a coherent state. We have checked that a globally 
coupled FitzHugh-Nagumo model Jl9[ produces similar 
results. The observed gain in coherence and synchroniza- 
tion in the network is achieved nearly instantaneously. 
This suggests the interesting possibility that neurons use 



noise to produce coherent signals. The global output sig- 
nal in that case should be markedly different from the 
output signal of an individual element. This behavior 
could potentially be investigated experimentally. Future 
work should also focus on the degree of excitability of the 
network as well as the degree of connectivity. 
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